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Amendments to the Claims : 

This listing of claims replaces all prior versions and listings of claims in the application: 

T.ifitin p nf Claims: 

1. (Previously Presented) A method, comprising: 

receiving a reference image and a first image, the first image having a perimeter having a 
first shape; 

determining a relative position of the first image and the reference image; 

using the first image, the reference image, and the relative position to generate a first 
corrected image having less perspective distortion relative to the reference image than the first 
image has, the first corrected image having a perimeter having a first corrected shape different 
from the first shape; 

using the first corrected shape to determine a focal length and rotation angles of a camera 
associated with the first image; and 

projecting the first image on a surface based on the focal length and rotation angles of the 
camera associated with the first image. 

2. (Cancelled) 

3. (Original) The method of claim 1, further comprising: 
projecting the reference image on the surface. 

4. (Original) The method of claim 3 further comprising: 

merging the projected reference image and the projected first image to fonn a panoramic 

image. 
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5. (Original) The method of claim 3 further comprising: 
projecting a three-dimensional object onto the surface; 

merging the projected three-dimensional object, the reference image and the first image 
to form a panoramic image. 

6. (Original) The method of claim 1 wherein the surface is cylindrical. 

7. (Original) The method of claim 1 wherein the surface is spherical. 

8. (Original) The method of claim 1 wherein the surface is planar. 

9. (Previously Presented) The method of claim 1, further comprising: 

receiving a second image, the second image having a perimeter having a second shape; 

determining a relative position of the second image and the reference image; 

using the second image, the reference image, and the relative position to generate a 
second corrected image having less perspective distortion relative to the reference image than the 
second image has, the second corrected image having a perimeter having a second corrected 
shape differeui from the second shape; 

using the second corrected shape to determine a focal length and rotation angles of a 
camera associated with the second image; and 

projecting the second image on the surface based on the focal length and rotation angles 
of the camera iissociated with the second image. 
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10. (Previously Presented) The method of claim 1, wherein determining the focal length and 
rotation angles further comprises: 

selecting; initial values foT the rotation angles and the focal length; and 

improving the accuracy of the selected values of the rotation angles and the focal length 

by: 

estimating a shape of the perimeter of the corrected version of the first image 
based on the selected values of the rotation angles and the focal length; 

comparing the estimated shape and the actual shape of the perimeter of the 
corrected version of the first image; 

adjusting the selected values of the rotation angles and the focal length based on a 
difference between the estimated shape and the actual shape of the perimeter of the corrected . 
version of the first image. 

1 1 . (Previously Presented) The method of claim 1 0, wherein improving the accuracy of the 
selected values of the rotation angles and the focal length further comprises: 

computing a difference between the selected values of the rotation angles and the focal 
length with the adjusted values of the rotation angles and the focal length; 
if the computed difference is below a threshold value: 

determining that the adjusted values of the rotation angles and the adjusted value 
of the focal length are the actual rotation angles and the actual focal length; 

otherwise, if the computed difference is not below the threshold value: 

selecting the adjusted values of the rotation angles and the focal length as the 
values of the rotation angles and the focal length; and 

repeating the step of improving the accuracy of the selected values of the rotation 
angles and the focal length. 

12. (Previously Presented) The method of claim 10, wherein the initial value of the rotation 
angles is select ed to be rotation angles of a camera associated with the reference image. 



PAGE 5/15 * RCVD AT 10/25/2004 7:21:1 1 PM [Eastern Daylight Time] * SVR:USPT0-EFXRF-1/4 * DNIS:8729306 * CSID:6508395071 * DURATION (mm-ss):04-18 



10/25/2004 16:23 FAX 6508395071 



FISH & RICHARDSON 



@006 



Applicant : John Peterson Attorney's Docket No.: 07844^62001 / P426 

Serial No. : 09/848,017 
Filed : May 3, 2001 
Page : 5 of 14 

1 3. (Origimil) The method of claim 1 , wherein the rotation angles of the camera associated 
with the first image is measured relative to rotation angles of a camera associated with the 
reference image. 

14. (Original) The method of claim 10 wherein the initial value of the focal length is selected 
based on a measurement of the first image. 

15. (Original) The method of claim 14 wherein the selected initial value of the focal length is 
the sum of a length and a width of the image. 

1 6. (Original) The method of claim 1 0 wherein a Newton* s iteration is used to adjust the 
initial values of the rotation angle and the focal length. 

17. (Cancelled) 

18. (Original) The method of claim 1 wherein the reference image is an image of a reference 
segment of a view and the first image is an image of a first segment of the view that overlaps the 
reference segment of the view, the method further comprising: 

correcting for perspective distortion in the first image relative to the reference image to 
generate the corrected version of the first image, 

1 9. (Original) The method of claim 1 8 further comprising: 

determining a position offset of the first segment of the view relative to the reference 
segment of the view, wherein correcting for perspective distortion is based on the determined 
position offset 

20. (Original) The method of claim 1 8 wherein the perimeter of the first image includes at 
least a first reference point and a second reference point and correcting for perspective distortion 
alters the shape of the perimeter of the first image by moving the first reference point relative to 
the second reference point. 
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21 . (Original) The method of claim 20 wherein the first and second reference points are 
vertices defined by the shape of the perimeter of the first image. 

22. (OrigiiL'il) The method of claim 21 wherein the shape of the perimeter of the first image 
is rectangular a nd correcting for perspective distortion alters the shape of the perimeter of the 
first image into a trapezoid 

23 . (Previously Presented) The method of claim 1 , wherein determining the focal length and 
rotation angles is further based on the shape of the perimeter of the first image. 

24. (Original) The method of claim 1 wherein the perimeter of the first image has the same 
shape as the perimeter of the reference image. 

25. (Previously Presented) An article comprising a machine-readable medium on which are 
tangibly stored machine-executable instructions, the stored instructions being operable to cause a 
machine to: 

receive a reference image and a first image, the first image having a perimeter having a 
first shape; 

determine a relative position of the first image and the reference image; 

use the first image, the reference image, and the relative position to generate a first 
corrected image having less perspective distortion relative to the reference image than the first 
image has, the first corrected image having a perimeter having a first corrected shape different 
from the first sliape; 

use the first corrected shape to determine a focal length and rotation angles of a camera 
associated with the first image; and 

project the first image on a surface based on the focal length and the rotation angles of 
the camera associated with the first image. 

26. (Cancelled) 
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27. (Original) The article of claim 25 wherein the instructions further cause the machine to: 
project the reference image on the surface. 

28. (Origina I) The article of claim 27 wherein the instructions further cause the machine to: 
merge the projected reference image and the projected &st image to form a panoramic 

image. 

29. (Original) The article of claim 27 wherein the instructions further cause the machine to: 
project a three-dimensional object onto the surface; 

merge the projected three-dimensional object, the reference image and the first image to 
form a panoramic image- 

30. (Origimd) The article of claim 25 wherein the surface is cylindrical. 

3 1 . (Original) The article of claim 25 wherein the surface is spherical. 

32. (Originiil) The article of claim 25 wherein the surface is planar. 

33. (Previoiisly Presented) The article of claim 25, wherein the instructions further cause the 
machine to: 

receive a second image, the second image having a perimeter having a second shape; 

determine a relative position of the second image and the reference image; 

use the second image, the reference image, and the relative position to generate a second 
corrected image having less perspective distortion relative to the reference image than the second 
image has, the second corrected image having a perimeter having a second corrected shape 
different from the second shape; 

use the second corrected shape to determine a focal length and rotation angles of a 
camera associated with the second image; and 

project the second image on the surface based on the focal length and rotation angles of 
the camera associated with the second image. 
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34, (Previously Presented) The article of claim 25, wherein determining the focal length and 
rotation angles Anther comprises: 

selecting initial values for the rotation angles and the focal length; and 

improving the accuracy of the selected values of the rotation angles and the focal length 

by: 

estimating a shape of the perimeter of the corrected version of the first image 
based on the selected values of the rotation angles and the focal length; 

comparing the estimated shape and the actual shape of the perimeter of the 
corrected version of the first image; 

adjusting the selected values of the rotation angles and the focal length based on a 
difference between the estimated shape and the actual shape of the perimeter of the corrected 
version of the first image. 

35, (Previously Presented) The article of claim 34, wherein improving the accuracy of the 
selected values of the rotation angles and the focal length further comprises: 

compuling a difference between the selected values of the rotation angles and the focal 
length with the adjusted values of the rotation angles and the focal length; 

if the computed difference is below a threshold value: 

determining that the adjusted values of the rotation angles and the adjusted value 
of the focal length are the actual rotation angles and the actual focal length; 

otherwise, if the computed difference is not below the threshold value: 

selecting the adjusted values of the rotation angles and the focal length as the 
values of the rotation angles and the focal length; and 

repeating the step of improving the accuracy of the selected values of the rotation angles 
and the focal length. 

36, (Previously Presented) The article of claim 34, wherein the initial value of the rotation 
angles is selected to be rotation angles of a camera associated with the reference image. 
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37. (Previously Presented) The article of claim 25, wherein the rotation angles of the camera 
associated with the first image is measured relative to rotation angles of a camera associated with 
the reference image. 

38. (Original) The article of claim 34 wherein the initial value of the focal length is selected 
based on a measurement of the first image. 

3 9. (Origin; J) The article of claim 3 8 wherein the selected initial value of the focal length is 
the sum of a length and a width of the image, 

40. (Orighliil) The article of claim 3 4. wherein a Newton's iteration is used to.adjust the 
initial values of the rotation angle and the focal length. 

41. (Cancelled) 

42. (Original) The article of claim 25 wherein the reference image is an image of a reference 
segment of a view and the first image is an image of a first segment of the view that overlaps the 
reference segment of the view, the instructions further causing the processor to: 

correct for perspective distortion in the first image relative to the reference image to 
generate the corrected version of the first image. 

43 . (Original) Hie article of claim 42 wherein the instructions further cause the machine to: 
determine a position offset of the first segment of the view relative to the reference 

segment of the view, wherein correcting for perspective distortion is based on the determined 
position offset. 

44. (Original) The article of claim 42 wherein the perimeter of the first image includes at 
least a first reference point and a second reference point and correcting for perspective distortion 
alters the shape of the perimeter of the first image by moving the first reference point relative to 
the second reference point. 
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45. (Original) The article of claim 44 wherein the first and second reference points are 
vertices defined by the shape of the perimeter of the first image. 

46. (Original) The article of claim 45 wherein the shape of the perimeter of the first image is 
rectangular and correcting for perspective distortion alters the shape of the perimeter of the first 
image into a trapezoid. 

47. (Previously Presented) The article of claim 25, wherein determining the focal length and 
rotation angles is further based on the shape of the perimeter of the first image. 

48. (Original) The article of claim 25 wherein the perimeter of the first image has the same 
shape as the perimeter of the reference image. 



PAGE 11/15 * RCVD AT 10/25/2004 7:21:11 PM [Eastern Daylight Time] * SVR:USPT0-EFXRM/4 * DNIS:8729306 * CSID;6508395071 * DURATION (mm-ss):04-18 



